Evaluation of Mixed-Initiative Knowledge Base Development Methods and Tools

نویسندگان

  • Ping Shyr
  • Gheorghe Tecuci
  • Mihai Boicu
چکیده

This paper presents a general framework for the empirical evaluation of mixed-initiative knowledge base development methods and tools. It also illustrates it with a knowledge acquisition experiment performed to validate a mixedinitiative method for acquiring problem solving rules directly from a subject matter expert. The main feature of this framework is that the evaluation is an integral part of system design and prototyping. The framework includes a repertoire of evaluation methods, guidelines for designing experiments based on these methods, and reusable evaluation utilities.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Mixed-Initiative Development of Knowledge Bases

Ample experimental evidence shows that manual solutions to the problem of building knowledge bases are highly inefficient, while fully automated, machine learning based, approaches have not yet led to practical solutions. This makes this problem an ideal test bed for developing mixedinitiative methods. In this paper we present such a mixedinitiative approach where a subject matter expert teache...

متن کامل

Seven Aspects of Mixed-Initiative Reasoning: An Introduction to the Special Issue on Mixed-Initiative Assistants

Mixed-initiative assistants are agents that interact seamlessly with humans to extend their problem solving capabilities or provide new capabilities. Developing such agents requires the synergistic integration of many areas of AI, including knowledge representation, problem solving and planning, knowledge acquisition and learning, multi-agent systems, discourse theory, and human-computer intera...

متن کامل

Mixed-Initiative Reasoning for Integrated Domain Modeling, Learning and Problem Solving

The main challenge addressed by this research is the knowledge acquisition bottleneck defined as the difficulty of creating and maintaining a knowledge base that represents a model of the exp ertise domain that exists in the mind of a domain expert. The mixed-initiative approach we are investigating, called Disciple (Tecuci et al. 1999; Boicu et al., 2000), relies on developing a very capable a...

متن کامل

EFL Teacher Education in Iran: Does It Promote Trainees’ Pedagogical Content Knowledge?

Teacher education programs can play a principal role in helping prospective teachers to acquire requisite knowledge and skills. Vital to the issue of teacher education is the efficient evaluation of such programs in promoting prospective teachers’ knowledge base. However, the literature contains very few reports of the evaluation of the Iranian EFL preservice teacher education program, which is...

متن کامل

Evidence for Informing Health Policy Development in Low- Income Countries (LICS): Perspectives of Policy Actors in Uganda

Background Although there is a general agreement on the benefits of evidence informed health policy development given resource constraints especially in Low-Income Countries (LICs), the definition of what evidence is, and what evidence is suitable to guide decision-making is still unclear. Our study is contributing to filling this knowledge gap. We aimed to explore health policy actors’ views r...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2001